Work Like a Bee - Taking Advantage of Diligent Crowdsourcing Workers
نویسندگان
چکیده
This paper presents our approach for the Crowd Sourcing Task of the MediaEval 2014 Benchmark. The proposed solution is based on the assumption that the number of Human Intelligence Tasks (HITs) completed by a worker is representative of his diligence, making workers who completing high volumes of work more reliable than low-performing workers. Our approach gives a baseline evaluation indicating the usefulness of looking at the number of task completed by a worker.
منابع مشابه
Optimal Testing for Crowd Workers
Requesters on crowdsourcing platforms, such as Amazon Mechanical Turk, routinely insert gold questions to verify that a worker is diligent and is providing high-quality answers. However, there is no clear understanding of when and how many gold questions to insert. Typically, requesters mix a flat 10–30% of gold questions into the task stream of every worker. This static policy is arbitrary and...
متن کاملPerform Three Data Mining Tasks with Crowdsourcing Process
For data mining studies, because of the complexity of doing feature selection process in tasks by hand, we need to send some of labeling to the workers with crowdsourcing activities. The process of outsourcing data mining tasks to users is often handled by software systems without enough knowledge of the age or geography of the users' residence. Uncertainty about the performance of virtual user...
متن کاملOriented Online Route Recommendation for Spatial Crowdsourcing Task Workers
Emerging spatial crowdsourcing platforms enable the workers (i.e., crowd) to complete spatial crowdsourcing tasks (like taking photos, conducting citizen journalism) that are associated with rewards and tagged with both time and location features. In this paper, we study the problem of online recommending an optimal route for a crowdsourcing worker, such that he can (i) reach his destination on...
متن کاملYork University at TREC 2012: CrowdSourcing Track
The objective of this work is to address the challenges in managing and analyzing crowdsourcing in the information retrieval field. In particular, we would like to answer the following questions: (1) how to control the quality of the workers when crowdsourcing? (2) How to design the interface such that the workers are willing to participate in and are driven to give useful feedback information?...
متن کاملEnhancing Knowledge Work Through Crowdsourcing in Adaptive Case Management Systems
Increasing the productivity of Knowledge Workers is considered as an important management challenge for an information society. The complexity of Knowledge Work confronts Knowledge Workers with tasks outside their expertise or overextend their physical capabilities. Crowdsourcing solves this problem by allowing Knowledge Workers to employ a global pool of work force for various types of applica...
متن کامل